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Abstract 

We prove three strong approximation theorems for the "supermar- 
ket" or "join the shortest queue" model - a law of large numbers, a 
jump process approximation and a central limit theorem. The esti- 
mates are carried through rather explicitly. This allows us to estimate 
each of the infinitely many components of the process in its own scale 
and to exhibit a cut-off in the set of active components which grows 
slowly with the number of servers. 
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1 Introduction 

The supermarket model is a system of single-server queues. Customers 
arrive as a Poisson process of rate A^A, where A G (0,1). Each customer 
examines d queues, chosen randomly from all queues, where d > 2, and 
joins the shortest of these d queues, choosing randomly if the shortest queue 
is not unique. The service times of all customers are independent rate 1 
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exponential random variables. We will be concerned with the behaviour 
of this model when A and d are fixed, over a finite time interval [0, to] i as 
N ^ oo. We shall consider the case when the system starts in some well- 
behaved state with low server loads (in a sense to be made precise below). 

This model has attracted attention because it turns out that the choice 
offered to customers, even if d = 2, dramatically reduces queue lengths; 
see jniUnilini; and in particular, the length of the longest queue, see jTUHH]. 
Given that our analysis relies on being very much larger than d, the model 
does not describe well the behaviour of a real supermarket. Rather it serves as 
an example where a simple dynamic routing rule leads to a greatly improved 
performance, which is of interest in the context of communications networks. 

Our results provide strong approximations for the supermarket model, 
and include a law of large numbers and a diffusion approximation. In arriv- 
ing at these results we have developed techniques to establish weak conver- 
gence of a sequence of Markov processes in infinitely many dimensions, 
where the jumps of are of order A^~^ and occur at a rate of order A^. 
The classical results for fiuid limits are set in a finite-dimensional context. 
We make essential use of the fact that the number of "active" components 
in X^ grows only very slowly with N. We have used direct and quantita- 
tive methods based on exponential martingales and strong approximation of 
Poisson processes by Brownian motion. These methods seem well-suited to 
deal with such "almost finite-dimensional" Markov processes. Earlier results 
for this model include laws of large numbers in El ^1 > quantitative 
concentration of measure estimates in [Hj and a central limit theorem [?]. 
See also [H] for a preliminary version of the law of large numbers presented 
in the present paper (for a more general range of initial conditions). 

The limiting behaviour of the supermarket model as — oo may con- 
veniently be described in terms of the vector Xt = {X^ : A; G N), where X^ 
denotes the proportion of all queues having at least k customers at time 
t. The process X = {Xt)t>o is a Markov chain. We will suppose throughout 
that Xq = xq with xq non-random and we will suppress the dependence of X 
on A^ to lighten the notation. Now X has the form of a density dependent 
Markov chain such as considered by Ethier and Kurtz in Chapter 11. 
Thus one might expect to be able to find a deterministic process {xt)t>o and 
a Gaussian process {■yt)t>o such that 

Xt = xt + 0{N~^/^), Xt = xt + N-'/\ + 0{\ogN/N). 

However the number of non-zero components in X grows with A^ so the 
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standard theory does not apply. 

We will see that, for small initial data, the component has a scale 
Ofc = X^+'^+--+'^'' which of course decays very rapidly with k. Thus the 
number of queues having at least k customers is of order Nak- We can find 
m of order log log such that Nam is of order 1. Thus we can exhibit a 
cut-off in the number of active components which grows only slowly with A^. 
Below the cut-off, for < m — 1, we prove convergence with explicit control 
of error probabilities for each of the log log active components. 

We thereby obtain results of the form 

Xf = x'^ + afcO (Vlog log log AT/ A^a^), 

Xf = x1 + Ar-V2^f ^ afeO(log iNak)/Nak). 

Note that each component is estimated in the correct scale, with an error 
depending on the number of queues active at that level. The log log log X 
in the first equation is a (small) price we pay for working with infinitely 
many components. These asymptotics will be established with a degree of 
uniformity in xq, which thus allows a dependence of xq on N. The Gaussian 
approximation relies, as in the finite-dimensional case, on a sophisticated 
coupling of the compensated Poisson process with Brownian motion due to 
Komlos, Major and Tusnady |Hj. 

We will give a third result, for < m — 1, of the form 

Xf = x1 + N-'/^jf + akO{{log\og\ogN/Nakf'). 

Here {'yt)t>o is a jump process with drift which depends on N but is of a 
simpler type than X in that it is a linear function of additive Poisson noise. 
The characteristics of 7 are derived in a simple and canonical way from those 
of X. Moreover 7 and X share a common filtration. The error term is larger 
than for the Gaussian approximation. On the other hand the derivation is 
significantly simpler. 

We obtain also the behaviour of the queue sizes at and above the cut- 
off. We see a residual randomness in (X™)t>o even for large values of N. 
This may be approximated in terms of an M/ M/ 00 queue with arrival rate 
N \{x^~^Y and service rate 1. Over a given finite time interval, there are no 
queues with lengths greater than m. 

Thus we will show for the supermarket model that its infinite-dimensional 
character does not prevent the derivation of precise asymptotics. We expect 
the general approach taken here to adapt well to a number of further examples 
of similar character. 
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2 Statement of results 



Let 5*0 denote the set of non-increasing sequences x = {x^ : A; G N) in [0, 1]. 
For X G 5*0, set x° = 1 and define A^f_(a;) = \{{x^~^Y ~ = 
x^ g^j-^fj ^^(^x) = A^(x) — (x). It is shown in ^3] that, given xq G 5*0, 

there is a unique solution {xt)t>o to Xt = b{xt) in Sq. Moreover, for any other 
solution {yt)t>o in Sq, Xq < ?/q for all k implies < for all and all t > 0. 

Recall that = x^+d+.-.+d"-' A; G N. Then a = (a^ : A; G N) is 
the unique solution in 5*0 to b{x) = such that linifc^oo^;*^ = 0; to see 
this note that x^^^ — A(x'^')'^ is independent of k for any solution x. Define 
||x|| = sup^ Ix'^'l/ofc, set E = {x E : ||x|| < oo} and set S = SoHE. Extend 
A± and 6 to by setting A^(x) = X{{y''-^f -{y^f) + , Xtix) = {y'^-y^+Y, 
where j/^ = (x^)"*". It is easy to check that b maps E to itself and is locally 
Lipschitz for the given norm. Thus, if xq G S, then {xt)t>o does not leave S 
immediately. Moreover, if ||xo|| < 1, then, by comparison with the stationary 
solution a, \\xt\\ < 1 for all t > 0. For p > 1 and to > set 

5'(p, to) = {xq £ 'S' : ||xj < p for all t < to}. 

The state-space / of the Markov chain X = {Xt)t>o is the set of non- 
increasing sequences in A^~^{0, 1, . . . , A^} with finitely many non-zero terms. 
Thus ICS*. The Levy kernel for X is given by 

oo 

K{x,dy) = [NX''4x)6e,/N{dy) + NX'l{x)6.e,/N{dy)] , 

k=l 

where Ck denotes the k-th standard basis vector. Given m G N, let {Xl^)t>to 
be a process starting from x™ and such that NX"^ is an M/M/oo queue, 
with arrival rate A^A(x™~^)'^ and service rate 1. We can now state our law of 
large numbers. 

Theorem 2.1. Set m = m{N) = M{k G N : Nak < (logA^)^}. There is 
a coupling of X"^ and X"^ such that, for all p > l,to > and all sequences 
R{N) with R{N) I i/log log log oo, we have 

sup P^.o(ViV|Xf ''^ - a;^ I > R{N)^ for some k < m - 1 
xoelnS{p,to) 

( ' 7^ A J or X^ ' for some t < to) ^ 0. 
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In particular 

sup sup |Xf — x^l/afc — ^ 

k<m—l t<to 

in probability, uniformly in Xq E I H S{p,to). 

We know, see jT3], that if p > and ||xo|| < p then — > as t ^ oo. 
Thus, for k < m — 1, the proportional error in approximating by the 
deterministic process is small for large values of A^. 

The central limit theorem shows generically that the power in Theo- 
rem |23 cannot be improved while the approximating process {xt)t>o remains 
deterministic. Our next result is a refined approximation which allows an 
improvement to N^^'^. Let jl he a Poisson random measure on x (0, to] 
with intensity 

i^idy, dt) = K{xt, dy)dt. 
We show in Section IHl that the linear equations 

lt=^ ! y\~^ - i>)idy, ds) + [ Vh\xs)^,ds (1) 

jRf*x(0,i] Jo 

have a unique cadlag solution (7^ : A; G N, t < to)- Set Xt = Xt + N~^/'^^f 

Theorem 2.2. Define m{N) as in Theorem \2.1\ There is a coupling of 
X and X, in a common filtration, such that, for all p > l,to > and all 
sequences R{N) with i?(A^)/(logloglog A^)^/'' — > 00, we have 

sup (Ar3/4 i^fc - I > RiN)al^^ for some k < m — l,t < to) ^ 0. 

xoelnS{p,to) 

The final result is a diffusion approximation. Let B^^B^^k G N, be 
independent standard Brownian motions. Set cr^(x) = \/A±(x)- We show in 
Section ini that the linear equations 

aX{xs)dBl{s) - [ crt{xs)dB'l{s) + [ Vb^Xshsds, t < to (2) 
Jo Jo 

have a unique solution {•y^ : k E N,t < to) with 

supE(sup 17^1^) < 00. 
fceN t<to 

Set Xt = xt + N-'/'^f 
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Theorem 2.3. Define m(A^) as in Theorem \2. 1\ There is a coupling of X 
and X such that, for all p > l,tQ > 0, there is a constant R, independent of 
N , such that 

sup P^o(iV|Xf - I > R\og{Nak) for some k < m - l,t < to) ^ 0. 

xoG/ns(p,to) 

We remark that there are ahernative versions of aU three theorems in 
which xo is replaced by Xq™"* = (xj, . . . , 0, . . . ) and A±(x) is replaced 
by \±{x)^'^\ so that the approximating deterministic dynamics are (m — 1)- 
dimensional. The proofs are a minor modification of the proofs given below. 
These alternative versions would have merit in any computational implemen- 
tation of the approximations since m is of order only log log N. 

3 Law of large numbers 

In the first half of this section, we fix N and A,R>1 and set m = mf{k G 
N : Nak < A}. We will obtain, subject to certain constraints, a global 
estimate on the probability appearing in Theorem 12.11 In the second half we 
will show that this estimate becomes small as ^ oo when A = (logA^)^ 
and when R is chosen as in Theorem 12.11 

Fix p > 1 and to > and assume that pA'^ < N'^~^. Set a = (log log — 
loglog(l/A))/logd, so that A^A"^" = 1 and Nak = x^+d+.-.+d'^-'-d'- _ If < a 
then Nak > 1, whereas if A; > a + 1 then Nak < 1- Hence, at least for 
sufficiently large N, we will have m G (a — 1, a + 2). 

Consider the case xq G S{p,to). Then Nx'^'^^ < Npam+i < Npa^ < 
pAd/N^-^ < 1, so = 0. Set Ti = inf{t > : X^^^ ^ 0}. Note that, 

while = 0, Xr+^ increases at rate NX{X^Y, whereas X™ + +^ 

mcreases at rate XA(X™-^)'^ and decreases at rate NX]^. We can therefore 
find an M/M/oo queue {Qt)t>o, starting from Xx™, without arrivals and 
with service rate 1, and a Poisson random measure p{dt, dx, du) on (0, oo)^, 
independent of Q and of intensity e~'^dtdxdu, such that, for t < Ti, 

ATX^+i = p{{{s,x,u) : s <t < s + u,x < XA(X™ )^}) 

and 

X(Xr + Xf+i) = Qt + p{{{s,x,u):s<t<s + u,x< NX{X^s'y}). 
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Define {Xr)t>o by 

NX^ ^ Qt + i^{{{s,x,u) : s <t < s + u,x < iVA(a;^-^)'^}) 

and set T2 = inf{t > : X^+Xl^+^ ^ }. Then {NX^)t>o is an M/M/00 
queue starting from A^x™, witli arrival rate N\{x"''^^Y ^'^d service rate 1. 
Fix r > 1 and set T3 = inf{t > : > ra„}. Fix > 1, set 

T4 = inf{i > : ^/N\X^ -x\\> RV^k for some k<m-l}, 

and set T = Ti A T2 A A r4 A to- Finally, set 

p = piN, X, d, xo, A, R, r) = P(T < to). 

Proposition 3.1. Assume that Xq G S{p,to), that A,R,p> 1 with pA'^ < 
N'^~-^, that r > p and that 

2rAioe"VAr(V2)(i-i/o;) < R < (to A 
where L — 2{da'^~^ + 1) and a — p + 1. Then p < Pi + P2 + Ps + Pa, where 

=A''r%/N''-\ 

P3 ^p%/{r-p), 

Pa =2mexp(-i?7(20(7'*^oe^-^*°)). 

Proof. It will suffice to show that P(T = Tj) < pj for i = 1,2,3,4. Recall that 
for a Poisson random variable Y of parameter v > Q and for a > we have 
P(>" > a) < v/a. For t <T we have NX{X^y < N\{rarr,Y < A'^r^/N^-^, 
so XJp^^ is dominated by a Poisson random variable Yi of parameter pi, and 
so 

P(T = Ti) = P(X^+^ = 1) < H^i > 1) < Pi- 

Since G S{p,tQ), we have < pofc for all /c G N and all t < to. For 
A; < m — 1 we have Ry/ak/N < akR/y/Nak < akR/VA < ak. Hence, for 
t <T and k <m-l, 

X^ < x'l + Ry/ak/N < aak. (3) 
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Then, for t < T, 

NX\{Xl''-y - {x^'-y\ < NXda'^-^af^WX^'-^ - x^'-^\ 
Set 

A = ii{{{t, x,u):t<T, NX{xf-^ A X^^-^ <x< NX{xf-^ V X™"^)'^}). 

Then A is dominated by a Poisson random variable Y2 of parameter p2- 
Hence 

P(T = T2) = P(A = 1) < P(F2 > 1) < P2- 

Note that X{x'^-^Y < = P'^^^m for all t < to- Thus NX^ < Nx^+Ys 

for a Poisson random variable Y3 of parameter Np'^amto and so 

It remains to estimate P(T = T4). For this we write 

Xl = xl + M^+ fh\Xs)ds (4) 
Jo 

so that ^ 

X^'^ - x,^ = + /" -6*^(a;,))cis. 
Jo 

Then we use a combination of exponential martingale inequalities and Gron- 
wall's lemma to obtain the desired estimate. First we investigate how small 
M will need to be to obtain the required bound on \X^ — x^\ iox k < m — 1. 
Note that 

\XX{x) - XX{y)\ < Xd{x^-^ V y^-y-^\x^-^ - y^-^\ + Xd{x^ V y^Y-^\x^ - y^\ 
so, provided that x^ y y^ < aa^ and x^"^ V y^"^ < aak-i, 

\XX{x) - XX{y)\ < da-^-Hla^K-Ok'-' - y'"'! + \x'' - y^\}. (5) 

Also 

\Xt{x) - A^(y)| < \x^ - + - y^+\ (6) 
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Hence, provided that y < aa^ and x'' ^ < aak-i, we have 

Ib^x) - b^{y)\/y/^ < L sup \x^ - y^\/^. 

j=k—l,k,k+l 

We note that the definitions of T2 and T3 force X^^ < ra-m for all t <T. Set 

f{t)^ sup sup\X^ -x';\/^. 

k<m—l s<t 

Then, for t < T and k < m — 2, 

\h\Xt)-h\xt)\/^k<Lf{t) 

and 

\h^~\Xt) - h^-\xt)\/^^i < Lfit) + ra^/^/^. 
Hence, for t <T, 

fit) < (M; + ra^t/V^) + L [ f{s)ds 

Jo 

where 

Mj* = sup sup I I /^/a^. 

k<m—l s<t 

Set ak = ^e"^*^" R^/ok/N and consider for A; < m — 1 the stopping times 
T'' = T':ATl, where 

= inf{t > : ±Mt > a^}. 

Suppose that T < A ■ ■ ■ A T"^-^ Then M* < \e-^^''R/^. On the other 
hand 

So by Gronwall's lemma 
Hence 

m— 1 

p(r = T4) < ^ p(T*^ < T) 

k=l 
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and it remains to estimate P(T| < T) for k < m — 1. For A; G N, x G S* and 

9 eR, set 

/(x, 6) = xl{x)h{e) + xt{x)h{-e), 

where h{6) = — 1 — 6. For t < T and A; < m — 1 we have X^'^ < aa^ so 

0^(Xt, < Xa''4_^h{e) + aafc/i(-^^) < aV^(^) (7) 
where (y'(^) = — 2 + e^^. Consider for > the exponential martingale 

= exp{iV^^(Xf - X^) - f ! {e'^'y' - l)i^(X„ dy)ds} 

= exp {NOM^ -N f ^)cis} 

and note that on the event < T we have 

Z^, > exp {N9ak - Na'^akgie)to}. 

By optional stopping K^Z^^) < 1, so by Chebyshev's inequality 

P(T_^ < T) < exp(-iVeafe + NaWg{e)to). 

We choose 6* = afc/(2cr'^afc7to), where 7 = (7(1) < 5/4. It is straightforward 
to check that < 1 so g{9) < 7^^. Hence 

F{Tl <T)< expi-Nal/iAa^a.-fto)) = exp(-i?V(16(TVoe'^*»)). 

The same bound applies to P(T^ < T). So we have shown that P(T4 = T) < 
P4 as required. □ 

Proof of Theorem \2.1\ We will determine conditions on sequences R{N) and 
r{N) so that, for A(X) = (logX)'^, as N ^ 00, all the constraints of Propo- 
sition are satisfied and, with an obvious notation, Pi{N) for i = 
1,2,3,4. Forp4(X) ^ it suffices that loglogXexp(-i22/(20cT%e2^*«)) ^ 
and hence that R/ \/log log log N — > 00. For psi^n) it suffices that 
r ^ 00. For p2iN) ^ it suffices that ^2-1/^^2 /jyi-i/d ^ q ^^^^ 
Pi{N) ^ it suffices that Ar/N^^^^^^ 0. If we can also arrange that 
R/VA and rA/(i?X(i/2)(i-i/d)) _^ q ^j^g^ g^.! the constraints of Propo- 
sition EUl will be satisfied eventually. A possible choice is to take r{N) = 
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jY{i/2)(i-i/d)/QQgjY^4 g^^^ g^^y sequence R{N) with i?(A^)/v/logloglogiV 
oo and R{N) / {log N)"^ 0. This proves the first part of the theorem. For 
the final assertion it suffices to note that for k < m — 1, R{N) / ^JNa^ < 
R{N)/^/A{N) ^Q. □ 

We remark that the choice R{N) = logN leads to a bound of the 
form p{N) < (7A^~(^/^)(^~^/'^) up to logarithmic corrections. This is the 
best rate of decay of probabihties we have found. We remark also that a 
marginally shorter proof can be had by replacing the exponential martin- 
gale inequality by Doob's L^-inequality, at the small cost of requiring that 
R{N) / ^y\og\ogN ^ oo. 



4 A refinement of the fiuid limit 

This section leads to a proof of Theorem 12.21 The deterministic limit (for 
components k < m — 1) just discussed will be refined by approximating 
the martingale M in by another martingale whose characteristics are 
determined by the limit path, and at the same time linearizing around the 
limit path. The accuracy of the approximation is thereby improved from 
N~^/'^ to N~^^^ at the cost of moving to an approximating process which is 
not deterministic but has a simple random structure, being a linear function 
of a Poisson random measure. 

Define a measure 9 on x (0, to] by 

^^{dy, dt) = K{xt, dy)dt. 

We will take /i to be a Poisson random measure with intensity v coupled, in 
a way to be specified, with the process X. Define M = {M^ : k & N,t < Iq) 
by 

= / y\fi-i)){dy,ds) 

and define 7 = (74*^ : G N, t < to) by 

7t = ViVMt + [ Vb{xs)jsds. 
Jo 

We show in Section IHl that we can write 7 as an explicit linear function of 
fl — 9 

7t = ViV / <l>t,,y(/i - z>) {dy, ds) (8) 
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where {^t,s s <t <to) is the N x N matrix-valued process given by 

d 

Thus 7 has a simpler stochastic structure than X. In particular, we can 
write the characteristic function of any finite-dimensional distribution of 7 
in terms of {xt)t<to and {^t,s ■ s <t <to). 
Recall that ^ 

Xt^xo + Mt+ / b{Xs)ds. 
Jo 

On the other hand, if we set Xt = + N~^/'^%^ then 

Xt = Xq + Mt+ j b{xs)ds+ I Vb{xs){Xs - Xs)ds. 
Jo Jo 

Set y = X - X, f> = M - M and 

At = f\b(X,) - b(xs) - Vb(xs)(X, - x,))ds. (9) 

Then ^ 

Yt^Dt + At+ f Vb(x,)Y,ds. (10) 
Jo 

We will obtain a good approximation if we can couple M with M to make 
D small. Define kernels Kq, K_ on (0, to] x E x by 

Ko{t, X, dy) = K{x, dy) A K{xt, dy), 
K±{t, X, dy) = {K{x, dy) - K{xt, dy))^, 

and let K^,{t, x, w, dx', dw') be the image of the measure 

Ko{t, X, dyo) <^ K+{t, x, dy+) ® K_{t, x, dy^) 

by the map {x', w') = {yo + y+, yo + |/_). Let (X^, Wt)t>o be a Markov chain, 
starting from {xq, 0), with time-dependent Levy kernel K^. Set 

AWt^O 
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Then (XJ t>o is a Markov chain with Levy kernel K and is a Poisson 
random measure with intensity 9. We have coupled X and W so that, as far 
as possible, they have the same jumps. Set T5 = inf{t > : |7™| > r^/a^}, 
where r is as in the previous section. Fix R > and set 

Tg = inf{t > : N^/^\Xl^ - | > Ra,/^ for some k<m-l}. 

Finally, set f = T A T5 A Tg and p = F{f < to). 

Proposition 4.1. Assume that the conditions of Proposition [Ql hold. Set 

H = ^d{d — 1)(t'^~^ and assume in addition that rA < A^{i/2)(i-iM and 

AHR\e^'^/N^/^ + 4rAtoe^*VAr(V4)(i-i/rf) < < ARLt^e^'^ A^/\ 

Then p < Pi + P2 + Ps + Pa + P5 + Pe, where Pi,P2,P3,Pi are defined in 
Proposition \3.1\ and 

P5 = 8(p'^ + l)toe2^*«/^^ P6 = 2mexp{-^V(20i?Ltoe^^*°)}. 

Proof. Given Proposition 13. 11 it will suffice to show that P(T = Tj) < pi for 
i = 5,6. By Proposition 16.11 



E(sup 17^1') < 8(p'' + l)toe'"oa 

t<to 



So P(T = T5) < p5 by Chebyshev's inequality. 

We now follow an argument similar to the proof that P(T = T4) < p^ in 
Proposition 13.11 Set 

fit)= sup sup|nV«f , 

k<m—l s<t 

A:= sup sup|A^|/af + f\Yr\ds/aZi, 

k<m~l s<t Jq 

bl= sup sup|£),V«f. 

A:<m— 1 s<t 

We note that 

Vh\x)y = Xd{x^-y-^y^-^ - Xd{x^)''~Y - 2/' + Z/'"^' 
so, provided that x'' < aak and x^^^ < aat-i, 

\Vb\x)y\/al/'<L sup Wl/a'/'. 

j=k-l,k,k+l 
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For t < to we have < pa^ < crak for all k, so for k < m — 1 

\Vb'{x,)Y,\/al/' < Lfit) + 6,,^.,\Yr\/alit,. 
Then, from equation (fTUj) we get 

f{t)<D: + A; + L f f{s)ds, 
Jo 

so, by Gronwall's lemma, f{t) < e^*(y4^ + D^) for all t < Iq. Note that, for 
k < m — 1, 

b''{y)-b\x)-Vb\x){y-x) 

= Kiy'^^y - i^'^'Y - d{x''-y-\y^-^ - x''-^)) 
- X{{y''f - {x'^f - d{xy-\y^ - x'')) 

so, provided that x^,y^ < aa^ and x^~^,y^~^ < aak-i, 
\b''{y) - b\x) - Vb\x){y ~ x)\ 

< HXiatlly'-' - x'~'\' + a^^l/ - x''\'). 

For t < T and < m — 1 we have \Xl^ - x'l\ < R^/oJN; moreover, as we 
showed at this implies that < a at- Hence 

\b\Xt) - b\xt) - W{xt){Xt - xt)\/a'J' 

< H\R\at\ + «^^)/(iV«f ) < 2CR'/N. 

Also, < |X™ - a;^! + A^-^/^|7rl so, for t < T, \Yl^\/a]lti < (ra^ + 

N-^/'^r^)/a]lti < 2r{A/Nf-^/^^'^\ It follows that 

i*, < 2HR\/N + 2rto{A/NY~^'^^'^^ < ^e'^'^ R/N'^/^ 

Set Cik = \e~^^°Ra]!^ /N^/'^ and consider the stopping times = T'^ AT^, 
where 

T| = inf{t > : ±Df > aj. 

Suppose that T < A • ■ ■ A f'^~\ Then D*^ < \e-^^''R/N^/^ so /(T) < 
R/N^/^ and T < Tg. Hence 

m— 1 

P(T = Te) < ^ P(T^ < T) 

A;=l 
14 



and it remains to estimate P(T^ < T) for < m — 1. 
For A; < m — 1 set 

ij\t,x,9) =(At(x) - \X{xt)Yh{e) + {\t{x) - \t{xt)yh{-e) 

+ {\X{x) - \X{xt))-h{-e) + {\t{x) - xt{xt))-h{e). 

Fix ^ > and consider for /c < m — 1 the exponential martingale 

= exp{Ne{Xj^ - - W^^) - [ [ (e^^^' - l)K+{s, X„ dy)ds 

Jo JRf* 

- f ! ie-'^'y' -l)K-{s,Xs,dy)ds} 
Jo JmJ" 

= exp{NeD^ ~N [ V^s, Xs, e)ds}. 
Jo 

For k < m — 2 and t < tg, for x'' < aa^ and < aa^-i, we can estimate 
as at (0), (©) (0) to obtain 

i;\t,x,9)/^k < gmiXlix) - \lixt)\ + \\tix) - \Hxt)\)/V^k 
< Lg{0) sup \x^—xl\ly/aj 

j=k-l,k,k+l 

SO, for t < T and k < m — 2, 

^lj\t,Xt,9)<Lg{d)R^/^. (11) 
Similarly, since we assume 

for t < T, X™ < < R\/ am-i/N and we can show that (fTT|) remains true 

for k = m — 1. By optional stopping we have E(Z|,fc) < 1 for all A; < m — 1. 

+ 

But on the event <T we have 

ZL > expiNOa'' - Lg{e)Rto^/IU~k}. 



We choose 6 = 2^fNa^ / {^LRta^), checking that ^ < 1, so that g{e) < 
56'^/4, and use Chebyshev's inequality to deduce 

P(f^ < f ) < exp{-N'^'^al/{bLRtQ^k)} = exp{-Ry{20LRtoe^^'°)}. 



The same bound applies to P(T^ < T). So we have shown that P(T = Tg) < 
Pe as required. □ 
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Proof of Theorem \2.iA Choose r{N) as in the proof of Theorem 12.11 so that 
r{N) oo and so pr,{N) 0. Assume R{N)/{\ogNf 0, and set s{N) = 
R{N)/ {\og\og\ogN)'^/\ Thens(Ar) ^ oo. Set R{N) = s{N){\og\og\ogNy/^ 
and r{N) = N^^/'^^^'^''^^'^^ /{logN)"^. It is straightforward to check that all 
the constraints in Propositions 13.11 and 14.11 are satisfied eventually. More- 
over, as in the proof of Theorem 12.11 we have Pi{N) —>■ for i = 1,2,3,4. 
Finally i?(iV)^/i? log log log ^ oo so also Pe{N) which proves the 
theorem. □ 

5 Diffusion approximation 

In this section we prove Theorem 12. 31 The method follows the lines set out in 
|3], Chapter 11. As we have already seen, our process X has around log log A^ 
active components, which have a wide range of scales. This will require 
special consideration in the implementation of the general method. We also 
have to deal with the fact that the variance of the diffusion approximation 
has degeneracies. The diffusion coefficient, obtained as the square root of the 
variance, then fails to be Lipschitz and some special care is needed to arrive 
at the desired convergence. 

Let {X^ : k E N,t > 0) he the supermarket process starting from Xo and 
recall equation (jD) 



Recall also that we set Xt = Xt + N ^/^7t, where (7^^^ : /c G N, t < to) is 
defined by the linear equations ^ 





and 




Set F = X - X and D = A/f - M. Then 
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where At is defined at We will obtain a good approximation if we can 
couple M with M to make D small. 

The coupling relies on the following approximation result of iSj: there 
exists a constant c G (0, oo) and a probability space on which are defined a 
compensated Poisson process Z of rate 1 and a standard Brownian motion 
W such that, for alH > and s G M, 

P(sup \Z{s) - W{s)\ > clogt + x)< ce~''l\ (12) 

Given independent compensated Poisson processes Z^, Z^, A; G N of rate 
1 we can construct X by the equations (jU and 

M^ = N-^{Z'1{n[ \X{Xs)ds)-Zt{N f \t{Xs)ds)}. 
Jo Jo 

On the other hand, by a theorem of Knight, see for example |l4j, there exist 
independent Brownian motions W^, W'^, A; G N, such that, for all A; G N and 

t<to, 

W^iN [ XiiX,)ds) = ViV / aiiXs)dBiis). 
Jo Jo 

The law of {B^, : A; G N) given {W^, W'^ : A; G N) is given by a measurable 
kernel. So we may assume that these processes are defined on the same 
probability space as {Z'l, Z^ : k e N) and that {Zl,W'l), {ZtW'l),k G N, 
are independent copies of {Z, W). 

Set T7 = inf{t > : |7f | > r^/^}. Fix R > and set 

Tg = inf{t > : N\X^ - | > R\og{Nak) for some A; < m - 1}. 

Finally, set f = T A T7 A Tg and p = F{T < to). 

Proposition 5.1. Assume that the conditions of Proposition [Ql hold, and 
assume moreover that A>e^ and R < \/A/2. There is a constant C < 00, 
depending only on d, X,p and to such that, if 

C + C{R^ + r A)/ log N <R< A/{2\ogA) 

then p < Pi + P2 + Ps + Pi + Pr + Ps, where Pi,P2, Ps, Pa are defined in Propo- 
sition \S~l\ and 

P7 = C'/r2, p^ = Cm{A-^ + {R\ogA)-'^). 
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Proof. Given Proposition 13. 11 it will suffice to show that P(T = Tj) < pi for 
i = 7,8. By Proposition 16.11 

E(sup|7rP) <8(p'^+l)toe2^*oa^. 

t<to 

So P(T = T7) < p7 for a suitably large C by Chebyshev's inequality. Set 
m= sup sup|i;Vlog(^^«fc), 

fc<m— 1 s<t 

A;= sup sup|Aj|/log(iVa,)+ f \Y:'\ds/\og{Na^_^), 

k<m—l s<t Jq 

Dl = sup sup |D^|/log(A^afc). 

k<m,—\ s<t 

Since Nam-i > A > e, we have Nak/\og{Nak) < A^afe_i/ log(A^afc_i) for all 
k < m — 1. So we can use an argument from the proof of Proposition 14. II to 
obtain f{t) < e^\A; + D;) for all t < to. 

The function f{s) = logs/{N^~'^Xs'^) is decreasing when s > e and e < 

A < Nam-i < (AiV'^-VA)i/^ so 

log{Nam-i)/{Na^) = f{Na^^,) > fiiAN^'^/Xf") > \ogN/{2A). 

Similarly, \og{N am-i) / N > \ogN/{2^/A). Hence 

r{Na^ + ^Nam)/\og{Na^^i) < ArA/logN. 

We estimate as in the proof of Proposition 14.11 to obtain for t < T and 
k < m — 1 

\b'iXt) - b'ixt) - Vb\xt){Xt - xt)\/\og{Nak) 

< HXR^afzl + a'lr^)/N\og{Nak) < 2HR^/{N\ogN) 

and 

|y,"|/log(iVa„^i) < (ra™ + iV-i/Vv/^)/log(iVa„_i) <4rA/(iVlogiV). 

So A*^ < 2to{HR^ + 2rA)/{N\ogN) < \e'^^'^R/N, provided C is chosen 
suitably large. For A; < m — 1, set = \e~^^° R\og{N ak) / N and consider 
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the event flk = {supj<'f IZ^^I > Ofc}. On Qq = Q \ {Qi U ■ ■ ■ U flm-i) we have 
D*f < \e-^'°R/N, sojif) < R/N and f < Tg. Hence 

m— 1 

P(f = T8) < 5^P(fi,) 

k=l 

and it will suffice to estimate P(fifc) for each k < m — 1. Fix k < m — 1. We 
can write = D+{t) - where D±{t) = Dl{t) + D^it) + D^it) and 

Diit) =N~\Zi - Wi){N fxi{Xs)ds) 

Jo 

Dlit) =N-'{Wl{N [ \l{Xs)ds)-Wi{N ! \l{Xs)ds)} 
Jo Jo 

Dlit) =iV-i/2 f{al{X,)-ai{xs)}dBl{s). 
Jo 

Hence P(nfc) < ql + qi + ql + q^ + ql + q^ where, for j = 1, 2, 3, = P((]i) 
and fi-!^ = {sup4<j. |-D±(t)| > «fc/6}. 

For t < T, we have A^X^) < cr'^ak so, taking t = Na'^a^tQ and x = 
Nak/Q — clogt in (jl2p . we obtain 

ql<F{ sup - > 

= ca%{NakY-^/^''''''°^ < ca%A'-^/'^'''-'''^ < C/{AA), 

for a suitable choice of C. 

We turn to estimate g^. This will rely on the following continuity estimate 
for Brownian motion: for T,h,6 > 0, setting n = [t//iJ , 

P( sup \W{t) -W{s)\> 6) 

s,t<T,\s—t\<h 

<P( sup \W{kh + t) -W{kh)\> S/2) 

fce{0,l,...,n-l},t<2/i 

< 2nP(supH^(t) > 6/2) < {2T/h)e-^^'^'^^^'\ 

t<2h 

For t < T we have 

<x,^ + |Xf - Xi'l + IX,'^ - I < pafc + R^/ak/N + /?log(Xafc)/X 
< (p + i?/ + R log A//l)afc < aofc. 
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so 



[ Xi{Xs)ds < a%Nak. 
Jo 

Also, using the inequalities © and for t < T, 



\N I (XliXs) - Xl{X,))ds\ 

< Nda''~HoRak{\og{Nak-i)/{Nak-i)+\og{Nak)/{Nak)} 







< 2da'^~HoR\og{Nak) 

and 



\N fiXtiXs) - X'l{Xs))ds\ 
Jo 

< Rto{log{Nak) + log(A^afc+i)lfc<m_2} + rto{Nam + \/Na^)5k,m-i 
<2UR\og{Nak), 

provided that C is sufficiently large. We take t = a %Nak, h = 2da^~HoR\og{Nak) 
and 

5 = Nak/Q = i?log(Arafc)/(12e^*°) 

to obtain 

^± - dR\og{Na,) "''P^"4608da'^-itoe2^*o ^ " ' 

for a suitable choice of C. 

It remains to estimate g^. We shall show below that there exists a con- 
stant Co such that, for t < and all G N, 

E{\^^\')<Co{x1-'-x1)A{x1~x1^'). 

Then, for t < T, 



N\a'liXt)-a'4xt)\ = VN 



((X^y - (XrT)+ - J x^ - X 
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so by Doob's L^-inequality 

Ho 



E(sup \Dl{t)\^) <4E [° N-'^\a'l{Xs) - a'l{xs)\'^ds < moCo/N^ 

t<T Jo 



Hence 

ql = P(sup \Di{t)\ > ak/6) < 230Atoe^^*°Co/(R\og{Nak)y < C{R\ogA)-y2 

t<T 

for a suitable choice of C. 

The argument for is similar. For t <T, 



iV|<TO-<(x,)| 



< xd2''-\{xtr-' + {N-'/'htT-'U-'l/y/K^t' - x^){xt'y-' 

+ Xd2'-\{xtt-' + {N-'/'\^',\f-')\^',\/^X{x',-' - xt){xty-\ 
so, by Doob's L^-inequahty, 

E(sup \Dl{t)\'^) < 4E /" ° N-^\(7X{Xs) - aX{xs)\'^ds 

< 8ci222('^-i)to(l + N^''-^^'^C{d))Co/N^ 
where C{d) = 1(1^(1)2'^). Hence 

g3 =p(sup|L'3(t)| >afc/6) 

t<T 

< 2152d222(<i-i)to(l + N^'^-^^/^C{d))Coe^'''°/{R\og{Nak)f 

< C{RlogA)-y2 

for a suitable choice of C. On combining this with the bounds for q]_ and q^. 
already found, we obtain the desired bound for pg. □ 
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Proof of Theorem\EIE Set A{N) = r{N) = (logA^)^/^ ^nd define Th{N) = 
mi{k EN: Nak< A{N)}. Set R{N) = {\ogNy/\l A to)/2. It is straight- 
forward to clieck tliat, if C is the constant appearing in Proposition 15. II and 
if ^ = 3C, then all the constraints in Propositions 13.11 and 15.11 are satis- 
fied eventually and moreover that Pi{N) — > for ^ = 1,2,3,4,7,8. Since 
fn{N) > m{N), this proves the theorem. □ 



6 Fluctuation variance estimates 

We have deferred from other sections the analysis of certain linear equa- 
tions associated with our processes. The basic questions of existence and 
uniqueness in suitable spaces may be resolved by standard methods, so we 
review this only briefly. The more delicate result. Proposition which is 
needed for the diffusion approximation, relies on the particular structure of 
our model. 

We recall the N x N matrix-valued equation 
d 

to be solved for < s < t < to- Note that, for xq G S{p,to) and t G [0,to], 
we have ||V6(xt)|| < L, where || . . . || is the operator norm corresponding to 
||x|| = sup^ \x^\/ak. Hence it is standard that this equation has a unique 
continuous solution with ||$t,s|| < e^'-*"'^^ for all s,t. 

The other relevant equations may be considered as stochastic perturba- 
tions of the preceding equation. In Theorem 12.21 we used the equation (|T)) 

= y/NM^ + f Vh^{xs)isds, t < to 
Jo 

and in Theorem 12.31 we used the equation (j2I) 

'y^ = y/NM^+ [ W{xs)isds, t < to- (13) 
Jo 

Here 

Mf = / y'{fi-i)){dy,ds) 

and ^ ^ 

\fNM^ = [ aX{xs)dBX{s) - [ at{xs)dBt{s). 
Jo Jo 
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Note that 

iVE(|Mfn = iV r / {y')'K{xs,dy)ds 




(A^(x,) + A^(x,))rfs = iVE(|M, 



t I J 

and A^(xt) + \'l{xt) < (p"' + l)ak for t < to- Hence a standard type of 
iteration argument, using Doob's L^-inequality, shows that these equations 
have unique measurable solutions with, respectively, 

E(sup|7fr) <8(p'^ + l)toe'^*oa, 

t<to 

and 

E(sup|7tT) <8(p''+l)toe2^*oafc. 

t<to 

The details for equation ([T)) follow below; equation Q may be treated in the 
same way. Note that for any vector y and for all A; G N 



j=k~l,k,k+l V 
Now let 

and for ri G N 



7i 

Then for each k 



Jo 



|7< ^* I < / 5^ Ids 



< 5^ / ^-^ ^ds 



j=k-~l,k,k+l V"'" V*^-^ 



SO using Cauchy-Schwartz 



\~{n+l),k ~{n),k,2 pt |~(n),j _ ~(n-l),i|2 

1^^<?,lH V / ^- Us. 

""^ j=k-l,k,k+J^ 
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Then for all < s < t 

|~{n+l),fc _ ^(n),fc|2 \~{n)J _~in-l),j>2 

sup — < 3LH 2, / sup — ds. 

Let h^'^\t) = supfcE(sup,<i 17^'^+^)'*^ - 7^)'Y/afc); then for t < to 

Jo 

Hence 
where 

M{t) = supE(sup|M,^|Vafc) 

k s<t 

< 4supsupE(|M,'=|Vafc) < 4t(p'^ + 1). 

k s<t 

We deduce that 7^"'' converges to a process 7* uniformly on [0,^0], and that 
7t satisfies (^. The uniqueness part of the proof is similar. Let 

g{t) = supE(sup \^^\^)/ak. 

k s<t 

Then it follows from the above estimates that for t < to 

git)<M{to)e''^''l 

It may be verified by substitution that the formula (jH)) gives an explicit 
representation of the solution of equation (jT)). 

Proposition 6.1. The solution {'y^ : G N, t < to) to (0j satisfies 

supsupE(|7f p)/min{xf"-^ - - < 00. 

ken t<to 

Proof. Note that A^(xt) < d{xt~'^ — xf), so 

x'l - = Xlixt) - Xl^\xt) - (xl - x^^) + (x^i - xt^') 
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Hence 



and 



Also 



Jo Jo 

f{x] - x]+^)ds < te^''+^^\x'l - x'l+^). 
Jo 

[ X'l(xs)ds <d [ (x^-^ - < dte^'^+^^^x^-^ - x'l). 

Jo Jo 



Fix £ > and set 



/(t) = supsupE(|7,^r)/5,^ 
feeN s<t 



where 5!^ = mm{xf ^ - x^, x^ - + e. Then f{to) < oo. Note that 

E(| f aX{x,)dBX{s) - f at{xs)dBt{s)\^) 
Jo Jo 

= I \X{xs)ds+ I {x^^-x^+^)ds<{dt + l)e^'^+^^*S^. 
Jo Jo 

We have 

V6'=(x)7 = Xd{x''-y~'^j''-'^ - {Xdix'^y-^ + 1)7^= + 7^=+^ 
We will make use of the following estimates 



E(| I'xdix'r'Y-Vs-'dsl') 

ft rt 



< [ X^d\x'l-^f^''-^^5^-^ds I E(|7,^-in/5^Vs 
Jo Jo 

<d^ f X%{xs)ds f f{s)ds<{d^ + dH)e^'^+^^'S^ f f{s)d 
Jo Jo Jo 



and 



E(| l\xd{x'^Y-' + i)^'M') 

Jo 

< f {Xdix^J^^-^ + lf6''Js f ¥.{\-i';\^)/6lds<{d+l)He^'^+'-^'8^, f f{s 
Jo Jo Jo 



25 



and 

E(| [\s^^ds\^)< f 6'+^ds f E{\^'+^\^)/6'^+^ds < e^''+^^'6'l f f{s)ds. 
Jo Jo Jo Jo 

Now, from equation (fT^ . for all t < to, 

E(KT)<A5f + ff{s)ds 

Jo 

where A = A{dt + 1)6(^^+1)* and B = 8d{d + l){dt + l)e(^+i)*. So /(t) < Ae-^* 
by Gronwall's lemma. This bound does not depend on e, so the proposition 
follows by letting e — ^ 0. □ 
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